Skip to content

[Moore Threads] Adaptation for ERNIE-21B and PaddleOCR-VL models on MUSA devices#4683

Merged
zjjlivein merged 1 commit into
PaddlePaddle:developfrom
YivYuan:musa/adaptation0618
Jun 23, 2026
Merged

[Moore Threads] Adaptation for ERNIE-21B and PaddleOCR-VL models on MUSA devices#4683
zjjlivein merged 1 commit into
PaddlePaddle:developfrom
YivYuan:musa/adaptation0618

Conversation

@YivYuan

@YivYuan YivYuan commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

Before submitting

  • Lint code. If there are lint issues, please format the code first.
# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py
  • Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

PR changes

Description

  • Added configs for 21B and OCR models
  • Added certain adapations for MUSA devices in CLI and some module imports

@YivYuan
[Moore Threads] Adaptation for ERNIE-21B and PaddleOCR-VL models on MUSA
58e26ca 
devices

* Added configs for 21B and OCR models
* Added certain adapations for MUSA devices in CLI and some module
  imports
@fxyfxy777

fxyfxy777 commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

/re-run all-failed

zjjlivein
zjjlivein approved these changes Jun 23, 2026
View reviewed changes

@zjjlivein zjjlivein left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@PaddlePaddle PaddlePaddle locked and limited conversation to collaborators Jun 23, 2026
@PaddlePaddle PaddlePaddle unlocked this conversation Jun 23, 2026
nepeplwu
nepeplwu reviewed Jun 23, 2026
View reviewed changes
Comment thread examples/config/musa/ERNIE-4.5-21B-A3B/sft/21b_8_gpus.yaml
@@ -0,0 +1,90 @@
device: musa

@nepeplwu nepeplwu Jun 23, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

文件命名风格建议和其他硬件对齐：https://github.com/PaddlePaddle/PaddleFormers/blob/develop/examples/config/metax/ERNIE-4.5-21B-A3B/sft/sft.yaml

Comment thread paddleformers/cli/train/ernie_pretrain/models/fp8_linear.py
try:
from paddle.incubate.fp8 import deep_gemm
except ImportError:
warnings.warn(

@nepeplwu nepeplwu Jun 23, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

建议直接使用formers自带的logger

Comment thread paddleformers/cli/train/ernie_pretrain/models/moe/token_dispatcher/fp8_utils.py
try:
from paddle.incubate.fp8 import deep_gemm
except ImportError:
warnings.warn(

@nepeplwu nepeplwu Jun 23, 2026

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

建议使用formers自带的logger

@nepeplwu

nepeplwu commented Jun 23, 2026

Copy link
Copy Markdown
Collaborator

新的硬件支持需要提供安装说明的文档，并在README给出引用，参考：
https://github.com/PaddlePaddle/PaddleFormers/tree/develop#%E5%AE%89%E8%A3%85

同时在能力矩阵里多硬件支持部分说明支持的模型：https://github.com/PaddlePaddle/PaddleFormers/tree/develop#%E5%AE%89%E8%A3%85

@zjjlivein zjjlivein merged commit fe035e6 into PaddlePaddle:develop Jun 23, 2026
35 of 43 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@nepeplwu nepeplwu nepeplwu left review comments
@zjjlivein zjjlivein zjjlivein approved these changes
+1 more reviewer
@fxyfxy777 fxyfxy777 fxyfxy777 approved these changes
Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@YivYuan @fxyfxy777 @nepeplwu @zjjlivein